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Abstract 

The problem of estimating a mean matrix of a multivariate complex normal distribution 
with an unknown covariance matrix is considered under an invariant loss function. By 



■ using complex versions of the Stein identity, the Stein-Haff identity, and calculus on 

O _ 

[ eigenvalues, a formula is obtained for an unbiased estimate of the risk of an invariant 



class of estimators, from which several minimax shrinkage estimators are constructed. 

1 Introduction 

The multivariate complex normal and complex Wishart distributions were first explored in 
Goodman [Tl], and followed by Khatri [20] • These models play an important role in signal 
processing methods. See Kay [19] for the need of complex data models and DoGondzic and 
Neborai [11] for a unified approach based on complex GMANOVA models to analyze and 
extend signal processing models. See Ratnarajah et al. [32], Micheas et al. |30], and Di'az- 
Garcia and Gutierrez- Jaimez [10] for recent development of complex data model. Lillest0l [26] 
first investigated Stein-like shrinkage methods on simultaneous estimation of a mean vector 
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of the complex normal model. However, shrinkage methods for these models have received 
less attention so far, although it is important to develop these methods beyond the maximum 
likelihood estimator of estimating the unknown signals in the multivariate complex normal 
distribution. The goal of this paper is to show how certain decision theoretical results concerning 
the problem of estimating a mean matrix of the real normal distribution can be extended to 
the complex multivariate normal case. 

In this paper, we consider the problem of estimating an m x p unknown constant complex 
matrix S that is observed with additive complex normal random errors in a decision theoretic 
set-up. Our observations are an m x p data matrix Z and a p x p positive definite Hermitian 
matrix S, which is represented as 

Z: mxp~CAr„^p(H, K®S), 

S : p X p CWp(Ti, n) with Z and S independent, 

where n > p, S is a pxp positive definite Hermitian constant matrix, and K is an mxm positive 
definite Hermitian constant matrix. Here we assume that S and S are unknown although 
we assume that K is known. Furthermore CA^mxp(3, K S) and CWp(S, n) stand for a 
matrix- variate complex normal distribution with the mean matrix S and the covariance matrix 
K ® S and a complex Wishart distribution with the degree of freedom n and the parameters 
S, respectively. In other words, the model ([1]) means that the density of K.'^/'^Z =: Z with 
respect to the Lebesgue measure on C™^^ is given as 

7r-™^'Det(S)-"^exp{-Tr((z-H)S-i(z-H)*)}, z G C^^^, 

where S = K^^/^H, while the density of S with respect to the Lebesgue measure on C!^^^ is 
given by 

Det(s)"-Pexp(-Tr(sS-^)) 
Det(S)"7rP(p-i)/2H^^,r(n + l-fc)' ^ ^ ^+ • 

Here r( • ) is the usual Gamma function, Tr ( ■ ) and Det ( ■ ) denote the trace and determinant 

of a square matrix, and the superscript "*" means the complex conjugate transpose of a matrix. 

Furthermore C™"^^ and C^^^ stand for the sets of all m x p complex matrices and of all p x p 

positive definite Hermitian complex matrices, respectively. 



Based on (Z, S) we consider the problem of estimating the mean matrix H with respect to 
a loss function 

£(3, (H, S)) = Tr {S-i(H - H)*K-i(H - H)}, 

where an m x p random matrix H is an estimator of S. The risk function corresponding to this 
loss function is 

7^(H, (H, S))=E[£(S, (H, S))], 

where the expectation above is taken with respect to the joint distribution of (Z, S). 

This estimation problem is important since it is a prototype of estimating the regression 
matrix of a complex MANOVA model and of predicting multivariate responses in a linear 
regression complex model. We extend a large body of the results obtained by Efron and 
Morris [12], Bilodeau and Kariya [5J, Kariya et al. [L8j, Konno [21], and van der Merwe and 
Zidek [38] in the multivariate real normal set-up to the complex normal set-up ([1]). The results 
in the real normal model were obtained by extensive use of the integration by parts approach, 
known as the Stein identity derived by Stein [SU [36] , and the Stein-Haff identity by Stein [35] 
and Haff [I5l|16]. In addition to these identities, the eigenvalue calculus, developed by Loh [271 
[28l [29] . Konno [21], and Kariya et al. [18], is important to the development for a systematic 
search for shrinkage estimators. We extend these approaches to the complex normal set-up. The 
Stein identity for the multivariate complex normal is easily derived by using an isomorphism 
between real and complex variables stated in Andersen et al. [1] while the Stein-Haff identity was 
extended to the complex Wishart distribution by Svensson and Lundberg [37] . These identities 
and the eigenvalue calculus for the complex matrix developed in this paper are exploited to 
establish a systematic search for shrinkage estimators for the model (IT]), which includes the 
FICYREG estimator of van der Merwe and Zidek [38] . 

Shrinkage methods for estimating the regression matrix in a multivariate linear regression 
model have been extensively investigated to overcome the shortcomings of the ordinary least 
squares estimator. The literature includes Brown and Zidek [71[8], Dempster p], and van der 
Merwe and Zidek [3H]. Later Breiman and Friedman [6] proposed to predict a future observation 
by a ridge-type shrinkage estimator in order to use information of correlated variables. See also 
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Bilodeau Oman [31], and Srivastava and Solanky [33j for further investigation on this 
problem. As mentioned in Srivastava and Solanky [33], we can use minimax estimators to 
construct better predictors in order to overcome shortcomings of the predictor based on the 
least squares estimator. This shows that the results obtained in this paper can be immediately 
applied to the problem of predicting a future observation in a multivariate linear model for 
complex data. 

The remaining parts of this papers are organized as follows. In Section [21 we state some 
notation and the integration by parts formulae. In Section [3l we develop shrinkage estimators 
for the known covariance case, which is an extension to the results obtained in Stein [35] and 
Zheng [39l HQ] . In Section HI we obtain unbiased risk estimate for invariant estimators, from 
which several shrinkage estimators are derived. In the Appendix, the results on eigenvalue 
calculus for the complex set-up and their proofs are developed. 

2 Preliminaries: Notation and Basic identities 

This section first presents some notation used throughout this paper. Next we introduce inte- 
gration by parts formulae, complex versions of the Stein identity and the Stein-Haff identity, 
which play vital roles in obtaining unbiased risk estimate in Sections [3] and HI 

2.1 Notation 

Let M and C denote the field of real and complex numbers, respectively. We represent any 
element cgC as c = a + b, where a, 6 G M. We also denote the real and imaginary 
parts of c by Re c and Im c, respectively. In particular we denote by the set of all positive 
real numbers. The conjugate of a complex number c is given by c := a — b. We define 
by MF and the sets of all p-tuples of real and complex numbers, respectively. We set 
RP = {(^1, £2, . . . , £p) e W : £1 > £2 > ■■■ > Ip > 0}. In this paper, these tuples are 
represented as columns. The sets of all m x p matrices of real and complex entries are denoted 
by M™^P and C™^^, respectively. The transpose and the conjugate of C are denoted by C 
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and C, respectively. Furtliermore tiie conjugate transpose of an m x p matrix C G C™^^ are 
denoted by C* = C. The set of p x p Hermitian positive definite matrices is denoted by C^^. 
For any c = a+-\/^b e C** (a, b e MP), we denote by [c] a 2p-dimensional real vector (a', b')'. 
For a positive integer q and real numbers ai, 02, . . . , ttq, Diag(ai, 02, . . . , ttq) denotes a q x q 
diagonal matrix with the i-th diagonal element Oj (i = 1, 2, . . . , g). For an m x p complex 
matrix C = A + (A, B e W'p), we denote by {C} a 2m x 2p real matrix 




Let g{x, y) be a real- valued function on an open set t/ e M^. We say that g is differentiable 
if dg/dx and dg/dy exist on U. Let u, v be real- valued functions on an open set [/ e R^. 
A function g :— u + \/ —\ v is called differentiable if u, v are differentiable. For z — x + 
\/^-ly {x, y e M) and differentiable function g{z) = u{z) + \/^^v{z), we define 

^ 2 \dx dy ) 2 \dx dy ) ' 

1 / du dv\ y/^-l f dv du 

'X ay J ^ 2 \dx dy ) 

It is checked directly that 
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dz^ 
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\^dx^ 


dy 



2 \dx dy J 2 \dx dy 



d d _ ^ 9 ^ d _ 

—z^l, —z^O, —z^O, —z = l. 
dz dz dz dz 

If g is differentiable, then 

d-z' ^ dE'- 

Let G = {gij)i=i,2, ...,m, j=i,2, ...,p be an m X p matrix, where gi/s are complex-valued differ- 
entiable functions on C"*xp. For z = (%)i=i,2,...,m,j=i,2,...,p G C"^^^, we set 

■ 9 

and we define 



9^ijJi=l,2,...,m,j=l,2,...,p 



R.(.V(ViG,).^(MViG),^|:g{|g.|;;iM} 



2.2 Complex normal distributions and the Stein identity 



Recall that a p x 1 complex random vector Z is said to have a p-variate complex normal 
distribution with a mean vector 6 E and a covariance matrix S G C^^*' if the density of Z 
with respect to Lebesgue measure on is given as 
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/z(z) 



Det(S)"^exp{-(z-0)*S"^(z-^)}, zG 



We use the notation Z ~ CNp{6, S) for this. 

Lemma 1. Let Z beapxl complex random vector having CNp{9 , S) and let g= {gi, g2, gp) : 
C''' — )■ be differentiable with 



E 



9 (Re gi 



d (Re 



< oo, 



E 



z=Z 



9(Im5(i) 



d (Im 



< oo, 2 = 1, 2, . . . , p. 



z=Z 



Then we have 

E[{z -eyi:-^g{z) + g*{z)i:-\z -6)] = e 

Proof. Note that 



fdiRegi) ^ d(lmgi 



^*S-ig(Z) + g*(Z)S-i(Z 



■^\d (Rezj) (9 (Im2;j) 



2[z-e]'{^-'}[g] 



z=Z 



and that Z ~ CNp{6, S) if and only if [Z] ~ A^2p([^]; (l/2){5]}), a 2j9-variate multivariate real 
normal distribution with a 2px 1 mean vector [6] and a.2px2p positive definite covariance matrix 
(1/2){I]}. By the Stein identity on a multivariate real normal distribution [see Stein ^6]], we 
have 

E{|z-.n(V2)Er'tei}^4|:{||l^.||:|} 



which completes the proof. 



□ 



2.3 Complex Wishart distributions and the Stein-HafF identity 

Assume that a. p x p Hermitian positive definite matrix S has a complex Wishart distribution 
CWp{Tl, n) with the density function Let G(S) be a p x p matrix, the (i, j) element gij{S) 
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of which is a complex- valued function of S = (sij). For a p x p Hermitian matrix S = (sjk), let 
D5 = {d/dsjk) be a p X p operator matrix, the (j, k) element of which is given by 

^ = ^(1 + ^,k) 1 ^,/ , + (1 - Mv^ ;,,/ J, A; = 1, 2, . . . , p. (4) 

osjfc 2 y(Re SjTc) a(Im Sjk) J 

Here is the Kronecker delta ( = 1 if j = /c and = if j 7^ A;). Thus the (j, /c) element of 
D5G(S) is 

i^som, ^ t |^(S, 4,1 . t {^(S) H- (1 - ^.)^5(i|;y(S)} . 

It is directly checked that dski/dsij = 5^5 jk, and that dski/dsij = SikSji. 

Lemma 2. Assume that each entry of G(S) is a partially dijferentiable function with respect 
to Kesjk and Imsjk, j, k = 1, 2, . . . , p. Under conditions on G(S) specified in Konno [23], the 
following identity holds: 

E[Tr(G(S)S-i)] = E[{n - p)Tr(G(S)S-^) + Tr(D5G(S))]. (5) 

Remark 1. The Stein-Haff identity was extended to an elliptically contoured complex distri- 
bution by Konno [23]. Hence, if we know the improved estimators for the normal case, we can 
establish the robustness of improvement for the elliptically contoured complex distribution in 
a manner similar to that demonstrated in Kubokawa and Srivastava [211 ES] • 

3 Known covariance case 

Estimation of a mean matrix of a real multivariate normal distribution is considered in Stein [5^ . 
Efron and Morris [12j, Zheng [391 HQ], and Ghosh and Sheih ||13j. Recently Beran [2l [3] devel- 
oped adaptive total shrinkage estimators with smaller asymptotic risk than the data matrix. 

In this section, we consider a complex analogue of this problem since the known covariance 
case gives an insight into estimation problem of the mean matrix with unknown covariance 
matrix. The problem treated in this section is stated as follows: Assume that m > p and 
that we observe an m x p random matrix Z with the coordinates Zij [i = 1, 2, . . . , m, j = 
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1, 2, . . . , p) that are independently and identically distributed as CN{^ij, 1) G C). Set 
H = (^ij), i.e., the {i, j) element of an m x p complex matrix H is given by We use notation 
Z ~ CA^mxp(S, to indicate that a random matrix Z has a multivariate complex normal 

distribution with a mean matrix S and a covariance matrix ^ Ip. We consider the problem 
of estimating the mean matrix 3 under a loss function 

£0(3, H) = Tr{(H-H)*(H-H)}, 

where H is an estimator of 3 based on Z. The risk function is given by 

7^o(3, 3) = E[Tr{(3-3)*(3-3)}], 

where the expectation is taken with respect to the distribution CA^mxp(S, ® Ip). 

3.1 Unbiased risk estimate for a class of invariant estimators 

The maximum likelihood estimator of 3 is given by 'S^ie = Z whose risk function is given 
by Tlo{Smie, S) = mp. However, it is expected that the estimator ^mie is improved by so- 
called shrinkage estimators. In order to search for shrinkage estimators in a systematic way, we 
introduce the following class of estimators and obtain an unbiased risk estimate for this class. 
This unbiased risk estimate enables us to find a variety of improved estimators. 

Let W = Z*Z and decompose W = ULU*, where U is a p x p unitary matrix such 
that UU* = Ip and L = Diag(£i, £2, ■ ■ ■ , ip), & diagonal real matrix whose z-th element {i = 
1, 2, . . . , p) is given by £j in the decreasing order. Note that all fj's are non-zero with probability 
one. We consider a class of estimators of the form 

3^, := Eh{Z) = Z[Ip + UH(L)U*], (6) 

where H := H(L) = Diag(/ii(L), /i2(L), . . . , ^p(L)) with /ij(L)'s, i = 1, 2, . . . , p, being real- 
valued functions on ]R>. This class is a complex version of a class of estimators appeared in 
Stein [21] and Zheng [391 SO] . The following lemma is the complex counterpart of an unbiased 
risk estimate for orthogonally invariant class of estimators of a mean matrix of the multivariate 
real normal distribution, which was proved by Stein [Mj . 
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Lemma 3. Assume that Z ~ CA^mxp(S, Im(X>Ip)- For the estimator Sh given by we have 



r P 



TZqCEh, S) = mp + E 



m - p + l)/ifc(L) + + 4 2^ — — h 4%(Lj 

fc=i ^ b>fc 



E 2 



w/iere /i^fc = {dhk/dik)(L) {k = 1, 2, . . . , p) . 



Proof. Using Lemma [T] and we have 



7^o(Hi^, H) = E[Tr{(Z-H)*(Z-H) + 2Re(V'2ZUHU*) + Z*UH'U*Z}] 



E 



mp + 2 Tr {Re (V'^ZUHU*)} + ^ f^/i,^ 



i=l 



Use Lemma [6] in the Appendix to evaluate the second term inside expectation of the right hand 
side of the above equation. □ 

Remark 2. We consider the real version of estimating the mean matrix of the multivariate 
normal distributions. Let X ~ A^mxp(S, Im ® Ip) and decompose X'X = OLO' where O is 
a p X p orthogonal matrix and L = Diag(£i, i, . . . , ip) are the ordered eigenvalues of X'X in 
decreasing order. Then the unbiased risk estimate for estimators 'Sh = X[Ip + OH(L)O')] is 
given by 



E[Tr (X - H)'(X - H)] 



E 



2{m-p + l)hk(L) + Ukhkk + 4 



b>k 



iML) - LhiL 



"^k - ICb 



+ (^khlilS) 



which can be obtained by replacing the factor 2 of hk{dhk/dik) in LemmaOwith 4. 



3.2 Alternative estimators 

The following proposition is a complex analogue of the results of Zheng [39] . 

Proposition 1. Assume that m > p and let 7i(L), 72(L), . . . , 7p(L) be functions satisfying 

(i) 0<7fc(L) < 2{m-p); 

(ii) {d^k/dik){L)>0fork = l,2,...,p; 

(iii) 7i(L)>72(L)>--->7p(L). 
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Then the estimator (|6]) with 

H.H,.,.-B..(2f),2f),...,2^) 

is minimax. 

Proof. From Assumptions (i)-(iii) and Lemma|3l it is easy to show that 7^o(Z[Ip+UHU*], S) < 
mp. □ 

Remark 3. Assume that m > p. From Proposition [H it is easily seen that a complex analogue 
of the crude Efron-Morris estimator Z[Ip — (m — p){Z*Z)^^ is minimax. 

Proposition 2. Assume that m > p and let hk(L) = — (m + p — 2k) /ik {k = 1, 2, . . . , p) in 
dH]) . Then the estimator of the form (E]) is minimax. 

Proof. Without loss of generality we can assume that £i > £2 > ■ ■ ■ > > 0. Let /ifc(L) = 
—Ck/C-k (A; = 1, 2, . . . , p) in ([6]), where c^'s are positive constants such that ci > C2 > • ■ ■ > Cp. 
Then using Lemma [3] and the fact that 4/ (f^ — 4) > 1 for b > k, we can see that the risk 
difference between Z and Z[Ip + UHU*] is evaluated as 

T = 7^o(Z, H)-7^o(Z[Ip + UHU*], H) 




where 

p 

Wkit) = 2(m + p- 2k)t -t^ -A ^ c^. 

b=k+l 

li Ch = m + p — 2h {h = k + 1, . . . , p), then each Wk (t) is maximized at t = {m + p — 2k) . Hence, 
for Cfc = m + p — 26 (A; = 1, 2, . . . , p), we can see that Wkijn + p — 2k) = Wk-iijn + p — 2k) < 
+ p — 2{k — 1)) for k = 2, . . . , p. Therefore we have 

< Wp{m — p) < Wp^iim — p + 2) < ■ ■ ■ < W2{m + p — 4) < Wi{m + p — 2), 

from which it follows that T > 0. □ 
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Remark 4. It is easy to extend the result to a known correlated covariance case. Assume that 
we observe an m x p random matrix Z that is distributed as CA^mxp(3, Im ® S) with an mx p 
unknown complex matrix S and a known px p positive definite Hermitian matrix S. Consider 
the problem of estimating S under the loss function Tr{(S — S)*(S — S)S^^}, where S is an 
estimator of S. Transforming Z — > ZS"^/^ =: Z, S — )■ HS~^/^ =: S, and S — )■ SS"^/^ =: H, 
the problem reduces to the case when S = Ip. Therefore, the Efron-Morris estimator of H 
is given by Z[Ip — (m — p){Z*Z)^^'S]. If S is unknown and if we observe S ~ CWpCS, n), 
we replace S with S/n to obtain an estimator Z[Ip — ((m — p)/n)(Z*Z)^^S]. This form of 
estimators is developed in Section HI Similarly it is easily seen that the Efron-Morris estimator 
of H is given by [Im — {p — m)(ZS~^Z*)~^]Z if p > m. If S is unknown and if we observe 
S ~ CWpCS, n), we replace S with S/n to obtain an estimator [Im — {{p — m)/n){ZS^^Z*)^^]Z. 
This form of estimators is also developed in Section |H 

4 Unknown case and invariant loss 

In the sequel of this section and the Appendix, we assume that K = 1^ since the results for 
the known matrix K can be obtained from those for K = 1^ by using a transformation similar 
to that given in Remark HI 

4.1 Unbiased risk estimate for a class of invariant estimators 

Consider a class of estimators of the form Z + G(Z, S), where G := G(Z, S) is an m xp matrix 
whose (z, j) element gij {i = 1, 2, . . . , m, j = 1, 2, . . . , p) is a complex-valued function based 
on (Z, S). 

Lemma 4. Assume that all elements of G{Z, S) are absolutely continuous functions of Z and 
S. Then we have 

7^(Z + G(Z, S), (H, S)) = mp + E[2Tr {Re (V'2G(Z, S))} + Tr{D5G*(Z, S)G(Z, S)} 

+ in - p)Tr {G*(Z, S)G(Z, 8)8-^}] . (7) 
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Proof. Use Lemmas [T] and [2l □ 
To describe our class of estimators, let F = Diag(/i, /2, . . . , /min(m,p)) be the eigenvalues 
of Z*ZS^^. For p > m decompose ZS^^Z* = UFU*, where U is an m x m unitary matrix. For 
m > p we decompose S = (A*)^^A^^ and Z*Z = (A*)^^FA^^, where A is a p x p non-singular 
matrix. We consider a class of estimators of the form 



3f7 :— Hf/(Z, S) 



Z{lp + AH(F)A-i} if m > p 
{I„ + UH(F)U*}Z ifp>m 



where H := H(F) = Diag(/ii(F), /12(F), /imin(m,p)(F)) whose i-th element hi := hi{F), 
i = 1, 2, . . . , min(m, p), is a real- valued function on jj™™^™''^). 
Let 

A(n,m,p;H) = X^|2(m -p+ l)h,{F) + 2f,h,,{F) + 4 ^ ^'^'^^^ ^ f ^'^^^ 

k=l ^ b>k ■'^ •'^ 

+ {n + p- 2)f,hUF) - 2fMF)h,iF) - 2 iB^n^J^MX^ (9) 

b>k J^-J^ J 

where hkk(F) = {dhk/dfk)(F), k = 1, 2, . . . , p,. 



Proposition 3. Under the suitable conditions, we have 
7^(H^,, (S, S)) = 



mp + E[A(n, m, p; H)] if m > p 

mp + E[A(n + m — p, p, m; H)] if p > m 

Proof. We apply Lemmas [HI and [TO] in the Appendix to ([7]). For m > p, set $ = H in the 
first equation of Lemma [8] and $ = FH^ in the second equation of Lemma [8] to get the risk 
representation for the case when m > p. For p > m, set $ = H in the first equation of 
Lemma [10] and $ = in the second equation of Lemma [10] to conclude the proof of the risk 
representation for the case when p > m. □ 



Remark 5. Assume that H = in ([T]). From [20], the joint distribution of the eigenvalues of 
Z*ZS~^ is, aparting from normalizing constants, 

jm—p 
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if m > p while it is 



np—m 
Jk 



m—l-f-rm 



k=l 



(1 + fk) 



m 



■k=l ^^j=k+l 



if p > m. Note that the substitution rule to get the second distribution from the first distribu- 
tion, i.e., 



is valid to obtain the second assertion of Proposition [3] from the first assertion of Proposition |3l 
Hence, if we know the estimator of the form Z{Ip + AHA^^} when m > p, we can easily write 
down estimators of the form + UHU*}Z when p > m by using the above substitution rule. 

Remark 6. We consider the real version of estimating the mean matrix of the multivariate 
normal distributions. Let X ~ A^mxp(S, ® Sp) and S ~ Wp{n, S), where X and S are 
independent. Let F = Diag(/i, /2, . . . , /mm(m,p)) be the eigenvalues of X'XS^^. For p > m 
decompose XS^^X' = OFO', where O is an mxm orthogonal matrix. For m > pwe decompose 
S = (A')^^A^^ and X'X = (A')^^FA^^, where A is a p x p non-singular matrix. We consider 
a class of estimators of the form S/^ := X{Ip + AH(F)A^^} where m > p, and H := H(F) = 
Diag (/ii(F), /12(F), . . . , /imin(m,p)(F)) whose i-th element hi := hi(F), i = 1, 2, . . . , min(m, p), 
is a real- valued function on Then the real version of unbiased estimate for the class 

of estimators is obtained by changing the coefficents of terms fkhkk, fkhl, and fkhkkhk- 
The real version of A(n, m, p; H) in ([9]) is given as 



(p, m, n) — )■ (m, p, n + m — p) 



P ( 

2(m - p + l)hk{F) + AhhkiF) 




+ (n + p-3)fkhliF) 



k=l ^ b>k 




4.2 Alternative estimators 



Proposition 4. Let 71(F), 72(F), . . . , 7min(m,p)(F) be functions satisfying 

(i) < 7fc(F) < max{2(m — p)/{n + p), 2{p — m)/{n + 2m — p)}; 

(ii) ((97fc/<9/fc)(F) > for k = 1,2, min(m, p); 

(iii) 71 (F) > 72(F) >••■ > 7min(m,p)(F). 
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Then the estimator (|8]) with 

'71(F) 72(F) 7mm(m,p)(F) 



H F = -Bias 



min(m, p) 



IS mimmax. 



Proof. From Assumptions (i)-(iii) and Proposition |3l it is easy to check that TZ{Sh, (S, S)) < 
mp. 



□ 



Corollary 1. The Efron-Morris estimator 



Z{I,-^^(Z*Z)-iS} zfm>p 
a.iEM) ^ ) n + p 

{I„ - ^'"^ {ZS-'Z*)-'}Z ifp > m 

n + 2m — p 



is mimmax. 



}(AS) 



Proof. It is immediately seen from Proposition HJ □ 
Proposition 5. For k = 1, 2, . . . , min(m, p), let 

/ (AS) (AS) (^•5) 

4-) = !!i±i^. H<-)(F) = -D,ag ( V. V- ■ ■ ■ • 

n~p+2k \ h J2 /mm(m,p) 

Then the estimator 

^ Z{Ip + AH(^^)(F)A-i} ifm>p 
{I™ + UH(^^)(F)U*}Z ifp>m 
IS mimmax. 

Proof. It suffices to prove that A := A(n, m, p; H) < for the case when /i > /2 > ■ ■ ■ > 
fp>0 and m > p. Put = — c^/ for /c = 1, 2, . . . , p in ([9]), where c^'s are positive constants 
such that Ci > C2 > ■ ■ ■ > Cp. Note that 
^^f 4(cfc-Cb) ^ 2{cl-cl) \ ^ ^ ^ 1 2(cfc - Cb) (2 + Cfc + c^) 

k=l b>k i f>'~ fb fk- fb ) I fk- fb 



£ EE 

k=l b>k 



"^jCk - Cb){2 + Ck + Cb) 
fk 



J2yUp - k)ck + 2ip - k)cl - 5^{4c, + 2cl}\. 
k=i ■'^ ^ b>k ^ 
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Hence, for H 



Diag(ci//i, C2//2, . . . , Cp//p), we have 



A < - 




Proceed in a way similar to the proof of Proposition [2] to see that the right hand side of the 
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A Appendix 

This section develops somewhat tedious computations on eigenvalues, which is a complex ana- 
logue of the results given by Loh pTj [28| [29] and Konno [22] . In Section lA.ll we give some 
results which is needed to prove Lemma [31 In Sections IA.2I and IA.31 we provide some results 
which is needed to prove Proposition [3] 

In the sequel of this section, we use the following notation: For a. p x q real matrix X = 
{xij)i=i^2,...,m,j=i, 2,...,p, define the matrix of differential as (dX) = (dxij). We also use the 
notation (dX)jj := dxij. For a m x p complex matrix X = Xi + a/— IX2, where Xi, X2 are 
real matrices, we write (dX) = (dXi) + V— l(dX2). 

A.l Eigencalculus for known covariance case 

Let W = Z*Z = ULU*, where U = (Mjj)i, j=i, ...,p is a p x p unitary matrix and L = 
Diag(£i, £2, . . . , ip) with diagonal elements £1, £2, ■ ■ ■ , £p {ii > £2 > ■ ■ ■ > £p > 0). Recall 
that 




Lemma 5. We have 




du. 




du, 



Proof. Taking the differential of W 



ULU* we obtain that 



dW = (dU)LU* + UL(dU*) + U(dL)U*. 



Multiplying on the left by U* and on the right by U we have 



U*(dW)U = (U*(dU))L + L(U*(dU))* + dL. 



(10) 
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But, taking the differential of U*U = Ip, we get 



(dU*)U + U*(dU) = 0. 



Reverting to tlie coordinates, we obtain from (fTOll and ([H 

1 

(U*(dU))., 



(U*(dW)U),, for 2^ J, 



for z = j. 



and 

(dL),, = (U*(dW)U),,. 

We note that 



(du). = j;«..(u*(du))., = y: ^(u*(dw)u)., = Y,Y. -f^m) 

c c^l bi,b2 c^l 

But, from W = Z*Z, we observe that 
from which it follows that 



(dU). 



61,62 c^i ' \ J«/ 

UicUhicUb2lZjbiSkb2 

61,62 Cytl 



EE 



UicUb^cUklZjbi 



ll — Ir 

61 C^l ' 



This completes the first equation of this lemma. 

To prove the second equation we take the complex conjugate of f|T2|) and get 



(U'(dU)) 



-4y(U'(dW)U),, forz^j, 
for i = j. 
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Using the above equation and noting that W = W since W is Hermitian, we have 



dzjk 



(dU)..(a^)=i:Mu'(dU)).(^) 



bi,b2 c^l 

UicUbicUb2lZjb2^kbi 



EE- 



bi,b2 Cy^l 



EE 



UicUb2l^kc^jb2 



I] — tr 
b2 C^l ' 



which completes the proof of the second equation of this lemma. The third equality follows 
from the fact that W is Hermitian while the forth equality follows from ([1] 
Finally, by f|T3|) and f lT^ . we have 



(dL),, {^\= (U*(dW)U), ^ ^ 



= ^ Ub,iUb2i{dW)b,b2 ( ^J- ) 
61,62 ^ 

^ ^ ^b\i'^b2i^jb\^kb2 ^ ^^ '^b\i'^ki^jb\i 
61,62 61 

which completes the proof of the third equation of this lemma. □ 

Lemma 6. Let $(L) = Diag ((y9i(L), v^2(L), • • • , ¥'p(L)), where 's {i = 1, 2, . . . , p) are 

differentiable functions from R> — > M+ . T/ien we have 

TV{Re(V',ZU*(L)U-)} = ^ {(m - p + l)^.(L) + 2 ^ ^"^^^'^ 2 ^^'^'<^> + 4|^(L)} 

fc L c>k k c k J 

Proof. Write $ and ipi for $(L) and v5j(L) (i = 1, 2, . . . , p), respectively. Note that 

Tr{Re(V'^ZU$U*)} = mTr H + ^ |^Tr (Z'Vz(U$U*)') + Tr (Z*V^U$U*)^ , (15) 
where = id/dzjk)j=i,2,...,m,k=i,2,...,p with 9/%^ = {9/5(Re z^-fc) + v^<9/5(Ini Zjfc)}/2. We 
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use Lemma [5] to evaluate the second term in the right hand side of (fT5|) as 
Tr(Z'Vz(U$U*y) = 

.... C^ifc 



Ef duu _ duii _ sr-^ dipl d£k' 1 
I ^^^^ ^^^^ ^dik'dzjk) 

El UkcUkc'lJ'blZjb , _ 



i,j,k,l ^ b c^l ' ^ 6 Cy^l ' 



+UklUii 7 ^Ukk'Ubk'Zjb 



k'b " 



EE 



7i 7i r 



k K. c^k 



We use Lemma [5] and the fact that dq/dz = dq/dz to evaluate the third term in the right hand 
side of (ITSil as 



Tr(Z*VzU$U*)) = 



_ diukmuii) 



i,j,k,l 



E \ duki duii _ difi dik' 
Zji< (piUil- h (piUklT{ \- UklUil } TTJ—l^ 

.... t OZjk OZjk ^ oik' OZjk 



^kVk - ikVc ^ ^ d(pk 
k-ic ^ dik 



\ 1^ p, — + '^^ 

k L CT^fc 



Putting the above two equations into f|T5l) . we have 



Tr{Re(V'^ZU$U*)} = ^Im^k + Y^ 

k I c^k 



ikVk - ic^c + Vc{ic -ik) , „ dLpk 
'n 7, T tk- 



■+k - 



^1 (m-p + l)(^fc + ^ 

k I c^k 



ik^k - ic^c p dipk_ 

4-4 ' dik 

^k 



Combining this equation with ( fTSi) . we completes the proof of this lemma. □ 

A. 2 Eigencalculus for unknown covariance case with m > p 

Next we record calculus on the eigenvalues for the case when m > p. Let A = {aij)ij=i^2,...,p 
he a. p X p nonsingular matrix such that 

A*SA = Ip, A*Z*ZA = F, F = Diag (A, A, . . . , U) 
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with /i > /2 > ■ • • > /p > 0. This means that we consider (Z, S) such that a matrix Z*ZS ^ 
has the distinct eigenvalues /i, /2, . . . , fp. 

Lemma 7. Let A"^ = j=i,2,...,p, A = (0^)^,^=1,2,...,^; and (A)-^ = (a*^)j, j=i,2,...,p- For 
i, k, k' = 1, 2, . . . , p, and j = 1, 2, . . . , m, we have 

>, ^ \ OlicO'hcO'klZ jb 



EE 



5 



Tj — / ^ O'bk'O'kk'Zjb, 

OZjk ^ 

^ L = a^'a^^ajkUik + V a'^'aikajba''^ + V a^^a^kaibo!''—^ , 

ds,j ^ h-tk h-tk 

Of, 



dsk.k' 



^k' i^kif i ■ 



Proof. Put W = Z*Z = (wij)i,j=i,2,...,p. Differentiating S = (A*)~^A-i and W = (A*)-iFA-\ 
we have 

(dS) = (A*)-^(dA-^) + (d(A*)-^)A-i 
(dW) = (A*)-iF(dA-i) + (d(A*)-i)FA-i + (A*)-i(dF)A-\ 

Multiplying these equations by A* on the left and by A on the right, we get 

A*(dS)A = (dA-i)A + A*(d(A*)-i) (16) 
A*(dW)A = F(dA-i)A + A*(d(A*)-i)F + (dF). (17) 

To obtain the derivatives with respect to d/dzjk-, we may assume that dS = 0. Then, putting 
(fT6l) into ( ITTl) and from some algebraic calculation, we have 

(dF)fc'fe' = ^afefc/acfe'(dW)6c (18) 

6, c 



and 

1 



Eci c, «ci«ac2fe(dW)ciC2 if / ^ &, 



{{dA-')A)ib={ f^-f^ (19) 
] if / = 6. 
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From ( IT9|) and the fact that 

d 



dz 



■jk 



■'C2ki 

C3 



we have 



— 6fc' — 

which completes the first equation of this lemma. 

Differentiating AA^^ = Ip, we have (dA)A~^ + A(dA~^) = 0. Multiplying this equation 
by A on the right and using the first assertion of this lemma, we have 

dan ^ da^^''^ ^ ab^hiCikbza}"'^^Zjhi 

^ bi,b2 b^M 64 637^61 ■' ^ ■' ^ 



EE 



O-ibi CLlnbiCLklZjbi 



64 bi^l •^^l 

which completes the proof of the second assertion. 
From f|T8l) we have 
dfk' 



a6ifc'a62fe'(dW)fcjfc2 j — ctbik'ab2k'ZjbiSb2k — Qfei 



r\ / ^uiK' ^U2K' \^ yoio2 \ o / / ^uih:' ^U2K' '^jui^U2K / ^uik^^kk' Zjbi'j 

which completes the third assertion of this lemma. 

To derive the derivatives with respect to s^- we assume that dW = in f ll6l) . Reverting to 
the coordinates, we have 

(dF),, = -^a,,aH/.(dS),fc (20) 

and 

((dA-i)A),,- = _L(A*(dS)A),,-, if 2^ J, (21) 
jj ft 

= -II 

/. - 



((dA-i)A),,- = _^(A*(dS)A),„ ift^j. (22) 
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Since A*(dS)A = (dA-i)A+A*(d(A*)-i) which implies that 2Re [((dA-i)A),,] = (A*(dS) A),i., 
we have 



((dA-^)A),, + ((dA-i)A),, = (A*(dS)A),,. (23) 

From (EU) - (ESD we have 



a'=^5^a''i^((dA-i)A),,, (^) + a^^' a''^^((dA-i)A),,, 
.«.'^{((dA^u(A)+((dA-)Au(^ 



g^ki-kj ab2fcab3fc(dS)b2fc3 



f f ^ \ 

b2,b3bi^k ■'^1 •^'^ ^ 

^kt-kj ah2kO'b3k5b2jh-ii + o'^' 0.b2k<ib3biO!'^'' -r^~^~~r^>>2i^>>3j 

b2,b3 b2,bsbi^k •'''1 ~ •^'^ 



+a'^-' ab2k(ibzbio!^^^ -r^--^—rh2j^bzi 

b2M bi^k •^^i ~ •^'^ 



+ ^ a'^^ajkaib^a 



bii 



fbi 



b^^k ^'^ 

which completes the proof of forth assertion of this lemma. 
Finally, from fl^U]) . we have 

= {dF)b^bi ( ^ — ) = — ^ ab2biab3bi fbi{dS)b2b3 ( ^ — ) = — ^ a'b2biCib3bifb-^Sb2jSb3i 

"^ij K^^ijJ b2M K^^ijJ b2M 

^jbi^^ibi fbi 1 

which completes the final part of this lemma. □ 
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Lemma 8. Let $(F) = Diag ((y9i(F), (p2(F), . . . , ipp(F)), where ipi(F) 's (i = 1, 2, . . . , p) are 
differentiable functions from R> . Then we have 

Tr{Re(V'^ZA$A-i)} = ^|/,v^fe,(F) + {m - p + l)y.,(F) + 2 ^ ^^^^^^^ ~ {^^^^^^ V 
Tr(D,((A*)-i$(F)A-^)) = ^|(2p - 1)^..(F) _ 2^ ^^^^^^^ ~ ^^^^^^^ - /,v.,.(F) 



k ^ b>k 

where (^fcfc(F) = {difk/ dfk){F), = 1, 2, . . . , p. 

Proof. Use notation v^fc, and v^^fc short for $(F), (y5fc(F), and (y9fcA;(F), respectively. To prove 
the first equation of this lemma, we first note that 

Tr {Re (V'^ZA^A"^)} = mTr $ + ^ ^Tr {Z'Vz((A')"^$A')} + Tr {Z*V^((A*)-^$A*)}^ . 

Now we use the first three equations in Lemma [7] to evaluate the second term inside expectation 
of the right hand side as 

Tt{Z'V.((A')-*A')} = E 

i,j,k,l ■' 

Jk 



ijt,i ^ ^^^^ ^^^'^ ^^^^^ 

EC — b-\k — 

\ ^m^^ii 2^ 2^ — f - f + ^ ^ 

i,j,k,l b2 bi^l •^''1 62 61 

«fc \^ - - dipi\ 

+Zjia an / 0'b2biO'kbiZjb2-;z-^ > 

i,j,l,b2 ^biy^l 



bi,b2 



iiauaboi 



-\- ^ ^ Zjij2ZjiaibiOjb2bi' 



Jl Jbi // Jbi 



-\-Zjb2Zjiaiiab2l 

= Tr(Z*ZA$A*), 

where $ = Diag(0i, 02, • • • , 0p) with 0^ = idipi/dfi)+Y,f^^^{(pi-(pb)/ifi-fb), = 1, 2, . . . , p). 
Similarly we use the first three equations in Lemma [7] to evaluate the third term inside expec- 
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tation of the right hand side as 

Tr{Z*V,((A*)-^$A*)} = E^-^^^f^ 

i,j,k,l 



i,j,k,i I "^"^^'^ ^^^^ ^^^^ J 



= Tr(Z*ZA$A*). 

Putting Z*Z = (A*)^^FA into the right hand side of the above two equations, we have 

■Vk - fbVb \ 

fk — fb J 



Tr{Re(V'^ZA$A-i)} = + - P + IV. + E ^^"^^^^^ 



k b^k 

which completes the first equation of this lemma. 

Next we prove the second equation of this lemma. Apply the chain rule first and use the 
forth and fifth equations of Lemma [7] to get 



Tr(D5((A*)-i#A-i)) = 



i,j,k ■' 



k ^ b^k ^ 



k ^ b>k ■f^ ■f^ 



fk'^kk, 



which completes the proof of this lemma. □ 



A. 3 Eigencalculus for unknown covariance case with m < p 

Let Z*S~"^Z = UFU*, where U = {uij)ij=i_,,^rn is an m x m unitary matrix and F 
Diag(/i, /2, ■ ■ ■ , fm) with diagonal elements /i, /2, • • • , /m (/i > /2 > • • ■ > /m > 0). 
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Lemma 9. For i, k, I, I' = 1, 2, . . . , p, j = 1, 2, . . . , m, we have 
dug ^ sr^sr^ Ujb^Ujb^Ubsis''^^ hsb^ 

dug ^ V V ^^''i^J'^''3big^''°%65 
dzjk ~ fi-fb. 

^fbi _ \^ „kb5 5 

■' b3,b5 

dsi^ ~ ^ ^ fi-K 

duki _ _ Y^ UkbSb2iUb3biZb2bJb3bss''*^s'''^ 

dsii ~ 2^ 2^ fi-bb, 

62,63,64,65 feiT^i 

^fl' - 647 165- 

qJ- = - 2^ Ub^l'Ubsl'Zb^biS^-'s ^Zbsbi- 

^■^ 62,63,64,65 

Proof. Let T = ZS'^Z* and take differential of T = UFU* to get 

(dT) = (dU)FU* + UF(dU*) + U(dF)U*, 
from which it follows that 

U*(dT)U = U*(dU)F + F(dU*)U + (dF) = (U*(dU))F - F(U*(dU)) + (dF). 
Therefore we have 

(U*(dU)),, = <! fj-fi 

while, for i = j, we have 



^ -(U*(dT)U),,- if^T^j 



if i = j, 



(dF),, = (U*(dT)U), 

Hence 



- (du,,(|-)^i:"..(u-(du)).,(^) 

EV-^ UibiUb^biUbal / iri^x / 9 
^ fi-fb. ^"^^'^'Ad^k 

62,62 61 ^« J( JOl \ JK 
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But 



J2 SliAi.,'^'"'"^hh = W'^hh- (26) 



Therefore we have 



dUil _ Uib^Ub2biUb3lSjb2s''''^Zb:ib5 _ Uibi^jbiUb-ils''''^ Zb^b^ 

^^1^ b2,b,,b,b,^l fl-fbi b^Mb^^l fl-fbi 

which complete the proof of the first assertion of this lemma. 

Similarly we have ((dU*)U)ij = (U*(dT)U)jj/(/j — /,) for i ^ j, from which it follows that 



M jfel Ub2lUb-ibi Sjb2 S^^^ Zb-ibs 

fl ~ fbi 



— — kb^i — 

Uib^UjiUb^biS Zb^bs 

63,6561^; •'^ •'^^ 

which completes the second assertion of this lemma. 
Furthermore, from (l25l) and fl26l) . we have 



dzi 



jk 



(dF),,,, f^) = (U*(dT)U),,,, (^) = J2^b,b,^b,bAdT)b2b, (^) 
\ J / 62, 63 \ J / 



Ub2biUbgbi^jb2^ ^b^b^ / ^ Ujb^Ub^biS Zb^b^i 
62, 63, ,65 63,, 65 

which complete the proof of the third assertion of this lemma. 

Next we prove the forth equation of this lemma. Use f l24l) to get 



Ub^j ^^^^ \Ub,j 



UkbiUb2biUbsi , . [ d 



But, since {ds''^^'^ / dsij) = —s^'^^s^^^, we have 



64,65 ^ ^ 64,65 
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Combining these two equations we completes the proof of the forth equation of this lemma. 
Similarly we have 



_ ^2 ^2 UkbiUiy^lUhsbiZb2b4.^bib^^S^*^ S^^'' 



62,63,64,65 bi^i ■^''^ 

which completes the proof of the forth assertion of this lemma. 
Finally, from (125|) . we have 



^6261^6361 2^6264 "5 "'"^ ^b-ib^i 



k ^ b>k 

Tr (D5Z*U$(F)U*Z) = - 



62,63 ^ ^ 62,63,64,65 

which completes the proof of the last assertion of this lemma. □ 

Lemma 10. Let $(F) = Diag ((y9i(F), v^2(F), {pm(F)), where ipi{F)'s {i = 1, 2, . . . , m) 

are differentiable functions from M™ — )■ IR+ . Then we have 

Tr{Re(V'^U$(F)U*Z)} = ^|/.^,,(F) + {p ~ m + 1)^,(F) + 2 ^ ^'^'^^J ~ {^^^^^^ 1, 

$:|aW(F) - 2(.n - mMF) + 2 5: /^V.(F)-AV6(F) 1 
k b>k J 

where v?fcfc(F) = (9v9fc/9/fc)(F), = 1, 2, . . . , m. 

Proof. Use notation and ipkk short for $(F), (y9fc(F), and <y9fcfc(F), respectively. To prove 

the first equation of this lemma, we first note that 

Tr {Re ((V'2U$(F)U*Z)} = pTi (U$U*) + ^ (ti (ZV'^U^U*) + Tr (ZV^U^U')^ . 

Now we use the first three equations in Lemma [9] and proceed in a way similar to the proof of 
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Lemma [8] in order to evaluate the second term inside the expectation of the right hand side as 
Tr{ZV'^UW}= Y: z^.^-^^^f^ 



E{ _ duki duii _ d^pi \ 

i,j,k,l ^ ^ 



<^ ZijipiUu 2^ — — + ZijifiUkl 2^ 

- - jb5- 
+ ZijUklUiiUkbiUb^biS Zb^bz, 



•dfb. 



\ ^z*)i63Mf,3« Y j~r^^^ + ^z*)ib^Ub^bi Y 

i,b3,l ^ bl^l •'''1 blytl 



Uibi 



fl — fl 



bi 



+ (ZS ^Z*)ib.^Ub3i^Uii 
= Tr(ZS"^Z*U$U*), 

where $ = Diag(0i, 02, • • • , 0m) with 0^ = fi{d(pi/dfi) + T^bj^i fii^i " Vb)/ifi - fb), (i = 
1, 2, . . . , m). Similarly we use the first three equations in Lemma [9] to evaluate the third term 
inside the expectation of the right hand side as 

Tr{ZV^U$U}= 2^ Zij ^— 

i,j,k,l 



Ef _ duki _ _ duii _ _ dipi 1 
S ZijipiUii-^— + ZijipiUkl-^ h ZijUklUii-^— '> 

i, j, k, I ^ ^-^ ^-^ ^-^ ^ 

E\ duki _ _ duii 

i, j, k^l ■' ■' 



ZijUklUii— — 

dzkj 



E{ UkbiUkb^UbsiS^'''' Zb^bs , - - Uib^UklUbsbiS^^'' Zb3b5 
< ZijipiUii 2^ — — + Zij^iUkl 2^ _ 

i,j,k,lMM^ bij^l •'^ •'''^ bi^l J''^ 

, - - - -ifes 

+ZijUklUiiUkbiUb3biS Zb3b5Trr~ 

\ (zS"^z*)63jMj, Y ~r~r^b3i + (zS"^z*)63jMjbj ^ Ub^bi 

+ {ZS~'^Z*)b,_,iUii^/-Ubsi 
Tr (ZS"^Z*U$U*), 
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Putting ZS ^Z* = UFU* into the right hand side of the above two equations, we have 

Tr{Re(V'^U$(F)U*Z)} = J^jm + /.m + E ^^^^tS^I 

k b^k ^ 

Ef , r , fk^k - fbVb + {fb - fk)^ 
< P'^k + jkVkk + 2^ T~~f 

k ^ b^k 

= ^Ifk^kk + ip-m + l)ipk + ^^^^ _ •{^^'' |, 
k ^ b^k ■'^ ^ 

which completes the first equation of this lemma. 

To prove the second equation of this lemma, we first note that 

Tr(D5Z*U$U*Z) = y ^(^>'dUk,m^k,iZk,i) 

^ dsij 

i,j,ki,k2,l 

ZkrjZk2i \ ViUk2i \- ViUk^i-^ \- Uk^iUk2i ^ — (■ (27) 

But, from the forth equation of Lemma |9l we have 

i,j,kuk2,l bi^l •'"1 

fbifm 



where we denote by (U*ZS^^Z*U)i/ the /-th diagonal element of a matrix U*ZS^^Z*U for 
/ = 1, 2, . . . , m. Similarly, from the last two equations of Lemma [9], we have 



and 



Eduk2i sr^ fbifi^i 

Zk,jZk2muk,i^— = -2^7— p 

i,j,kuk2,l b^^l^^ 



E- dipl v-^ _ _ dipi dfbi 

ZkijZk2iUkiiUk2iT: — — / ZkijZk2iUkj^iUk2iTr^T: — 

OSij ^-^ Ofb, OSij 

i,j,ki,k2,l i, j, ki, k2,l,bi 



-y(u*zs-iz*u),,;(u*zs-iz*u),,,-^^ 
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Putting these three above equations into (!27|) we conclude that 
Tr(D,ZUWZ*) = -E|2E7^ + /^'^ 



z I ^ /z - A '5// 



which completes the proof of the second assertion of this lemma. □ 
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